CLAIMS: 



Having thus described our invention, what we claim as new, and desire to secure by Letters 
Patent is: 

1 . A dynamic handwriting recognition system for a pervasive device comprising: 
a touch screen device; 

a stylus means enabling a user to write on said touch screen, said touch screen generating 
dynamic information associated with stylus writing; 

a digital image capture means mounted in said pervasive device for obtaining images of said 
stylus as said user writes on said touch screen; 

means for processing said obtaining images and extracting non screen-related information 
associated with stylus manipulation by said user; and 

handwriting recognition means receiving both said dynamic touch screen information and 
extracted non touch screen-related information from said processed images for recognizing 
writing of said user, wherein improved handwriting recognition is achieved. 

2. The dynamic on-line handwriting recognition system as claimed in Claim 1, wherein said 
extracted non screen-related information include tilt parameters associated with stylus 
manipulation. 

3. The dynamic handwriting recognition system as claimed in Claim 1, wherein said pervasive 
device comprises a Personal Digital Assistant (PDA) device. 
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4. The dynamic handwriting recognition system as claimed in Claim 2, further including a touch 
screen control device for generating coordinates of said stylus writing upon said touch screen. 

5. The dynamic handwriting recognition system as claimed in Claim 2, wherein said digital 
image capture means obtains images in a plane perpendicular to a plane defined by said touch 
screen device. 

6. The dynamic handwriting recognition system as claimed in Claim 4, wherein said pervasive 
device implements pattern recognition means for extracting said non touch screen-related pen 
information. 

7. The dynamic handwriting recognition system as claimed in Claim 6, wherein said stylus 
means includes elements enabling recognition by said pattern recognition means. 

8. The dynamic handwriting recognition system as claimed in Claim 7, wherein said elements 
enabling pattern recognition includes colored segments in a structure known to said pattern 
recognition means. 

9. A method for dynamically performing handwriting recognition in a pervasive device 
including a touch screen device and a stylus means enabling a user to write on said touch screen 
device, said method comprising the steps of: 

a) generating dynamic information associated with stylus writing; 

b) mounting a digital image capture means in said pervasive device that is adapted to obtain 
images of said stylus as a user writes on said touch screen; 

c) processing said obtaining images and extracting non screen-related information associated 
with stylus manipulation by said user; and 
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d) recognizing writing of said user utilizing both said dynamic touch screen information and 
extracted non touch screen-related information from said processed images, wherein improved 
handwriting recognition is achieved. 

10. The method for dynamically performing handwriting recognition as claimed in Claim 9, 
wherein said extracted non screen-related information include tilt parameters associated with 
stylus manipulation. 

1 1 . The method for dynamically performing handwriting recognition as claimed in Claim 9, 
wherein said pervasive device comprises a Personal Digital Assistant (PDA) device. 

12. The method for dynamically performing handwriting recognition as claimed in Claim 10, 
wherein step a) of generating dynamic information includes the step of generating coordinates of 
said stylus writing upon said touch screen. 

13. The method for dynamically performing handwriting recognition as claimed in Claim 10, 
wherein said digital image capture means is mounted to obtain images in a plane perpendicular 
to a plane defined by said touch screen device. 

14. The method for dynamically performing handwriting recognition as claimed in Claim 12, 
wherein said processing step c) includes implementing pattern recognition means for extracting 
said non touch screen-related pen information. 

1 5. The method for dynamically performing handwriting recognition as claimed in Claim 14, 
further including the step of facilitating stylus recognition by a pattern recognition device. 

1 6. The method for dynamically performing handwriting recognition as claimed in Claim 1 5, 
wherein said stylus recognition is facilitated by including colored segments in said stylus that is 
known to said pattern recognition device. 
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17. A pervasive device comprising: 

a touch screen device having a handwriting surface; 

a stylus means enabling a user to write on said touch screen surface, said touch screen device 
generating dynamic information associated with stylus writing; 

a digital image capture means mounted in said pervasive device for obtaining images of said 
stylus as said user writes on said handwriting surface; 

a means for processing said obtaining images and extracting non screen-related information 
associated with stylus manipulation by said user; and 

a handwriting recognition means receiving both said dynamic touch screen information and 
extracted non touch screen-related information from said processed images for recognizing 
writing of said user, wherein improved handwriting recognition for said device is achieved. 

18. The pervasive device as claimed in Claim 17, wherein said extracted non screen-related 
information include tilt parameters associated with stylus manipulation. 

19. The pervasive device as claimed in Claim 19, further including a touch screen control device 
for generating coordinates of said stylus writing upon said touch screen. 

20. The pervasive device as claimed in Claim 18, wherein said digital image capture means 
obtains images in a plane perpendicular to a plane defined by said touch screen device. 

21 . The pervasive device as claimed in Claim 20, wherein said pervasive device implements 
pattern recognition means for extracting said non touch screen-related pen information. 
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22. The pervasive device as claimed in Claim 21 , wherein said stylus means includes elements 
enabling recognition by said pattern recognition means. 

23. The pervasive device as claimed in Claim 22, wherein said elements enabling pattern 
recognition includes colored segments in a structure known to said pattern recognition means. 
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